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Abstract 

o 

^SJ We show that the maximization of the sum degrees-of-freedom for the static fiat-fading multiple- 

input multiple-output (MIMO) interference channel is equivalent to a rank constrained rank minimiza- 
tion problem (RCRM), when the signal spaces span all available dimensions. The rank minimization 
^sO corresponds to maximizing interference alignment (IA) so that interference spans the lowest dimensional 

subspace possible. The rank constraints account for the useful signal spaces spanning all available spatial 
dimensions. That way, we reformulate all IA requirements to requirements involving ranks. Then, we 
present a convex relaxation of the RCRM problem inspired by recent results in compressed sensing and 
low-rank matrix completion theory that rely on approximating rank with the nuclear norm. We show 
that the convex envelope of the sum of ranks of the interference matrices is the normalized sum of their 
corresponding nuclear norms and introduce tractable constraints that are asymptotically equivalent to the 
rank constraints for the initial problem. We also show that our heuristic relaxation can be tuned for the 
multi-cell interference channel. Furthermore, we experimentally show that in many cases the proposed 
algorithm attains perfect interference alignment and in some cases outperforms previous approaches for 
finding precoding and zero-forcing matrices for interference alignment. 
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I. Introduction 

A recent information-theoretic breakthrough established that at the high signal-to-noise (SNR) regime 
every user in a if -user wireless interference network can enjoy half the capacity of the interference free 
case J21. Therefore, interference is not a fundamental limitation for such networks since it accounts for 
only constant scaling of the interference free case capacity, provided that it is sufficiently mitigated. Such 
a surprising result is possible when interference alignment is employed. IA is a sophisticated technique 
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first presented in (4[ and subsequently utilized in [2] as a means of showing the achievability of y 
degrees-of-freedom (DoF) for the if -user interference channel. The DoF of an interference channel can 
be interpreted as the number of interference free signaling dimensions, including time, frequency, or 
space. 

Intuitively, IA serves as a means for obtaining as many interference free dimensions for communication 
as possible and in practice stands for designing the transmit and receive strategies for each user-receiver 
pair of a wireless network (2l-||8l. For the case of static flat-fading MIMO channels, such as the ones 
studied in [5 ] and |6], where both transmitter and receiver have perfect channel knowledge, the flexibility is 
confined to designing the transmit precoding and receive zero-forcing matrices to maximize the achievable 
spatial DoF. Unfortunately, such matrices are NP-hard to obtain |[T3l . closed form solutions have been 
found only for a few special cases such as ||2l and Ifl2ll . and the problem is open for limited dimensions 
ifTOl . Even characterizing the feasibility of perfect IA is a highly non-trivial task as discussed in recent 
work 1 10] and lTT3l . The hardness to either find perfect IA solutions or even decide for feasibility is the 
cost of the problem's over constrained nature. A review of the current status of IA techniques is presented 
in 0. 

As an alternative to closed form designs, several algorithmic approaches have been proposed in the 
literature such as 0, lfl4ll . lfT31 . and 07). Many of those methods aim to minimize the interference 
leakage at each receiver so that -at best case- interference alignment is perfectly attained. The suggested 
insight for their effectiveness is that when perfect interference alignment is possible, then interference 
leakage will be zero and such algorithms may obtain the optimal solutions. Although a fair metric to 
optimize, as we show in this paper, interference leakage is not the tightest approximation to the notion 
of DoF which is typically the desired objective. When perfect alignment of interferences is not attained, 
the objective remains to maximize the available spatial DoF, that is the prelog factor of the capacity at 
the high-SNR regime. 

In this work, we present a variational characterazation of IA in terms of signal and interference space 
ranks. Specifically, we pose full rank constraints on the useful signal spaces and minimize the rank of the 
interference spaces. The full rank constraints ensure useful signal spaces spanning all available spatial 
dimensions. The rank minimization guarantees interference spaces collapsing to the smallest dimensional 
subspaces possible. We show that under the full rank constraints, minimizing the sum of ranks of the 
interference matrices is equivalent to maximizing the sum of spatial DoF for static flat-fading MIMO 
systems. The variational characterization, even though it is harder to solve exactly than solving a set of 
bilinear equations for perfect IA as the ones in 10 and iflOll . suggests a natural relaxation that leads to 
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a good approximation algorithm. 

Hence, we establish a new heuristic for near optimal interference alignment and maximization of the 
sum of spatial DoF. Using results from |[T9l and EOl we suggest that the sum of the nuclear norms of 
the interference matrices is the best objective function in terms of convex functions and is equivalent 
to the £i-norm of the singular values of the interference matrices. As intuition suggests, the ^i-norm 
minimization of the singular values of interference matrices will provide sparse solutions, translating 
to more interference free signaling dimensions. Interestingly, we show that the leakage minimization 
techniques presented in (9), Ifl4ll . and |[T5l minimize the £2 -norm of the singular values of the interference 
matrices which accounts for "low" energy solutions rather than sparse ones. To deal with the (non-convex) 
full rank constraints we suggest that positivity constraints on minimum eigenvalues of positive definite 
matrices serve as a well motivated approximation. 

An interesting aspect of our approach is its inherent robustness to a challenging caveat that the leakage 
minimization approaches face: for some cases of special interest, such as symbol extended single antenna 
interference channels, the iterative leakage minimization approaches may converge to zero dimensional, 
or rank deficient signal spaces, yielding zero or very low DoF |[T6l . This caveat is due to the fact that the 
beamforming and zeroforcing matrices for IA are constructed as a function only of the interference links. 
Then, the randomness of the wireless medium is left to take care of the full rank signal space conditions, 
which it does when the channel matrices are full and do not have a specific structure. Our nuclear norm 
heuristic avoids these singularities due to positivity constraints on eigenvalues, explicitly enforced on all 
signal spaces; these constraints involve all direct links of the network. Therefore, our approach can be 
used to generate interference alignment beamforming and zeroforcing matrices for any channel structure 
of interest. 

Then, we extend our approximation algorithm to the K-cell interference channel ifTTll . where each cell 
consists of several users and show that additional affine constraints on the precoding matrices are posed. 
These affine constraints are tractable and can be added in a straightforward manner to our approximation, 
hence, we develop a similar convex programming approach. This approximation is once more motivated 
by the fact that IA can be posed as a rank constrained rank minimization on an interference channel with 
structural constraints on the beamforming matrices. 

The last section contains an experimental evaluation of the proposed algorithm. Our experiments suggest 
that the proposed scheme is sum-DoF optimal for many setups where perfect IA is possible. Furthermore, 
in some cases it provides extra DoF compared to the leakage minimization approach, when perfect IA is 
not attained and is robust to singularities met by the leakage minimization approach on diagonal channel 
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structures. We conclude with a discussion on further research directions. 

II. System Model 

We consider static fiat-fading i'T-user MIMO interference wireless systems consisting of K transmitters 
and K receivers. We assume that each transmitting user is equipped with M t transmit antennas, each 
receiver with M r receive antennas, and all K transmitting users are synchronizing their transmissions. 
Each user, say k G /C, wishes to communicate a symbol vector G C rfxl to its associated receiver, 
where K, = {1, 2, . . . , K} and d represents the "pursued" DoF by user k, that is the number of symbols it 
wishes to transmit. To aid intuition, we note that achievable DoF can be perceived as the number of signal 
space dimensions that are free of interference. Prior to transmitting, user k G JC linearly precodes its 
symbol vector to obtain s& = V^x^, where G C M ' xd denotes the precoding matrix whose d columns 
are linearly independent. We consider signal vectors with an expected power constraint E {||sfc|| 2 } < P, 
for all k G /C. The downconverted and pulse matched received signal at receiver k is given by 

K 

y k = H fc>fc s fc + ^2 H fci ;Si + w fe 
i=i,i^k 

K 

= H fcjfc V fc X fc + ^ H fci /V;X/ + Wfc, (1) 

l=l,ljtk 

where Hj j G C A/,xM ' represents the channel "processing" between the j'th user and the ith receiver 
and Wfc G C MrXl denotes the zero-mean complex additive white Gaussian noise vector with covariance 
matrix ct^Im, , where i, j, k G K,. Each receiver k G K,, linearly processes the received signal to obtain 

K 

Uf y k = Uf H feife V fe x fe + Uf Yl H M V/xj + Ufw fej (2) 

l=l,l^k 

where G C MlXd is the corresponding linear zero-forcing filter with d linearly independent columns. 
Hence, span (U^Hfc^Vfc) constitutes the useful signal space in which receiver k G /C expects to observe 
the symbols transmitted by user k, while span ^{U^H^V;}^ is the space where all interference is 
observed. We denote by {X/}/^ ; , k the horizontal concatenation of matrices Xi, . . . , X^x, X^ +1 , . . . X/< 
We denote this K-user MIMO interference channel as an (M r x M t , d) system, in the same manner as 
in El, where all signal spaces span all available dimensions. For all the cases considered we assume 
d < mm(M t ,M r ). 

For practical reasons one mig ht consider Vf V fc = f I d , for all k G K.. This might be a setting where 
each column of represents a beamforming (or signature) vector assigned to a user in a group (or a 
cell) of d users and enforces orthogonality among user signal subspaces. Accordingly, we may as well 
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assume that the columns of each zero-forcing filter Ufe, for all receivers k € 1C, form an <i-dimensional 
orthonormal basis, if practical interest requires such a construction. 

Remark 1: We note that for simplicity we made the assumption that the number of transmit antenna 
elements are the same at all transmitters or receivers and all users wish to transmit d > symbols. 
However, the results that follow can be easily carried to the case where transmitters and receivers might 
not have the same number of antennas. 

III. Interference Alignment as a Rank Constrained Rank Minimization 

In this section we show that for each user k G K, the maximum achievable DoF can be put in the 
form of an RCRM problem. We suggest a new optimization framework for the Interference Alignment 
problem instead of the one for perfect IA as presented in |9). The optimization aims for the maximum 
interference suppression possible, when the signal space of each user is required to span exactly d spatial 
dimensions worth of communication. The perfect IA conditions being stricter require that interference 
signals are nulled out using linear processing of the received signal at each receiver, when the useful 
signal space spans d dimensions. To generalize the perfect IA framework, we use ranks of matrices to 
account for the number of useful signaling and interference dimensions. Interestingly, we show that the 
RCRM formulation is equivalent to the sum DoF maximization in an (M r x M t ,d) K system, where each 
useful signal space spans d dimensions. Then, we use this framework to develop a new approximation 
algorithm and compare its tightness to existing interference leakage minimization approaches. 

We begin by stating the perfect IA requirements. In an (M r x M u d) system and for all k G K, perfect 
IA requires that 

UfH fc ,,V, = dxd) Vl€/C\fc, (3) 
rank (uf H M V fc ) = d, (4) 

where ([3]) enforces all interference spaces to have zero dimensions posterior to zero-forcing and Q 
enforces the useful signal to span all d dimensions. 

Remark 2: Observe that ([3]) is a set of bilinear equations in the unknown precoding and zero-forcing 
filters. Recently, a feasibility question has been raised as to whether a system admits perfect interference 
alignment or not. When the channel coefficients are selected randomly and independently, [ 1 ] claimed 
that proper systems should have a perfect alignment solution almost surely. An (M r x M t , d) K system 
is called proper, i.e. perfect IA is expected to be feasible almost surely, when the number of variables is 
less than or equal to the number of equations, and this is equivalent to M r + M t — d(K + 1) > 0. 
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Interestingly, if we look at the problem of finding the precoding and zero-forcing matrices when the 
channel coefficients are arbitrary and given, the problem is computationally intractable. In particular, 
Razaviyayn et al recently established that for an arbitrary K-user MIMO interference channel, checking 
the achievability of a certain DoF tuple {d\, . . . , dx} is NP-hard when each user and transmitter has more 
than 2 antennas iTTBl . Therefore, solving the perfect IA set of bilinear equations in a single-shot manner 
cannot be performed efficiently, in the general case. Additionally, scenaria of multiple symbol extensions 
for the MIMO case, or multi-cell systems as the ones presented in iPTTTl . lack a similar definition to a 
proper system, however the sum DoF maximization is still an achievement one should be aiming for. 
Hence, it is interesting to obtain a more general framework for the IA problem that not only captures 
the notion of what are the maximum DoF conditions, but also quantifies what one should be optimizing 
to achieve this DoF. Of course, a hard optimization problem might be equivalently or even harder than 
solving a set of bilinear equations. However, generalizing the formulation will provide helpful cues for 
good approximation schemes and better understanding of the problem. 

We continue with rewriting ([3]) 

UfH M V, = (W, VlelC\k 

^ {U^H fc> /V;} ;=1 = [Odxd ■ ■ ■ Odxd] 



{H.k,iVi}f =1¥k 



Odx(-fsr-i)d) 



and defining the signal and interference matrices for all k E JC 



S fe (U fc) V fe ) = Uf H fc>fc V fe g C dxd , (5) 



For ease of notation we refer to Sfc Vfe) and fUfc,{Vj}^_]J as and Jfe, respectively. The 
space spanned by the columns of Sfc is the space in which the kth receiver expects to observe the 
transmitted signal Xfc. Accordingly, the space spanned by the columns of Jfc accounts for the interference 
space at receiver k G K,. Now, we restate ([3]) and Q in terms of ranks 

rank(Jfc) = 0, (7) 
rank(Sfc) = d, (8) 

for all k G tC. 

To motivate the rank notation we use the following lemma to characterizes the spatial degrees of 
freedom for a given user k of an (M r x M t , d) K static flat-fading MIMO interference system. 



i K 



■idx(K-l)d 



(6) 
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Lemma 1: Let {V i}f =1 be a given set of precoding niters and be a given zero-forcing filter 
employed by user k G /C. Then, the achievable spatial DoF by user k for these sets is 



Proof: We have for k G K 

d k 



A 



d k = [rank (S fc ) - rank (J*)] • 



J(Us fc ;Uy fc ) 
log(P) 

log dot (l d + (J fc jf + a 2 !^ 1 S fe Sf ) 



lim 

P->oo 



lim 

P-s-oo 



lim 

P-tco 



lim 

P->oo 



log(P) 

logdet((J fe Jf +a 2 I d )" 1 S fe Sf) 

log dot (S fc Sf ) - log dot (J fc jf + a 2 I d ) 
log(P) 

Er = T fc) log(A 4 (S fc Sf)) 



log(P) 

Egg^ log (A, (JfeJg) + ^ 
log(P) 



n + 



E ^)log(P)-^ J ^log(P) 



lim 

P->oo 



rank( 



log(P) 
[rank(S fe ) - rank (J fe )] + , 



where [a] 



a , a > 



(9) 



(10) 



(11) 



and Aj(A) is the ifh largest eigenvalue of A. The above result is possible 

,a < 

due to the eigenvalues of the S^S^ and JfcJ^ scaling linearly with P for given precoding, zero-forcing, 
and channel matrices. □ 



Lemma 1 implies that to maximize the per user DoF we have to design transmit and receive strategies 
in a sophisticated way, such that this difference of ranks is maximized. More precisely, for an (M r x 
M t , d) K system where each user aims for d DoF, the following set of K "parallel" rank constrained rank 
minimization problems has to be solved 

min rank (Jfc) (12) 
s.t.: rank(S fc ) = d. (13) 
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It is obvious, that when perfect IA is possible ( [12] ) and ( [13] ) will find it, or else the best possible solution 
will be obtained for user k G K, which will be equal to 



max (rank(Sfc) — rank (Jfc)) 



(14) 



s.t: rank (Si 



d. 



Remark 3: As noted before, for the constant A'-user MIMO interference channel it is known that the 
maximum per user achievable DoF using linear precoding and zeroforcing schemes is d* = M j^i , almost 
surely ifTOl . hence aiming for more than d* seems unmotivated. In that regard, when aiming for d < d* , 
we should expect that optimally the rank of each interference can go down to zero, as perfect I A requires. 
Hence, why use the rank formulation? As we see in the following, the fact that the rank formulation 
completely captures the notion of per user DoF assists us in tightly approximating this objective. The 
nature of our approximation favors solutions where the interference has low rank (i.e., users get higher 
DoF), instead of low energy (i.e., small interference leakage). This is of particular interest when perfect 
IA is feasible but hard to obtain, or for interference channels where the notion of proper is not clearly 
defined, such as cellular networks. 



Apparently, it is not trivial to solve in parallel a set of the K optimization problems in ( 12 1 and ( 13 1. 
Alternatively, we can maximize the sum-DoF of all K users through the following RCRM. 



V : 






K 


min 


^rank (J fe ) 




k=l 


{U»}£l 




s.t.: rank (S& 


) = d, \/k G /C. 



Theorem 1: A solution to V maximizes the sum of spatial degrees of freedom for an (M r x M t , d) K 
static flat-fading MIMO interference channel, when every signal space spans d dimensions. 
Proof: For all selections of Vi, . . . , Vk G C A/ ' xd and Ui, . . . , \Jr G C MrXd satisfying the constraints 
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of V we have that 



K 



K 



A 



^2 dk = ^2 t rank ( Sfe ) - rank ( Jfe )] + = Kd ~ ^2 rank ( J, =) 



fc=i 



k=i 



k=i 



A { K \ 

<^=> arg max ^ <4 = arg max < Kd — ^ rank (Jfc) > 
{Vt}F =1 fc=l IV,>/L I fc=l J 



A' 



A' 



arg max c4 
{V,}/^ fc=l 



arg min ^ rank (J^) . 



□ 



The orthogonality constraints for the precoding and zero-forcing matrices were ommited in the RCRM, 
since we can always linearly transform them so that the columns of each of these matrices are mutually 
orthogonal. Namely, we can rewrite the precoding matrices as = qI^r!^, where q!^ G (^M t xd j s an 



orthonormal basis for the column space ofV fc and eC 



•<dxd 



in the linear combinations yielding the columns of Then we may use J 7fQ!k' as tri e precoding 



is the matrix of coefficients participating 

(v) 
d ^k 



matrix. Accordingly, we use orthonormal matrices Q fe constructed by decomposing Ufc to Q fc R fc , 
where Q fc u) G C M ' xd and Q fc u) G C dxd . Observe that span (Q^) = span(V fc ) and span (q ( ^ = 
span (Ufc) for all k G /C. Moreover, the ranks of the interference and signal matrices are oblivious to 
full-rank linear transformations 



rank (J k ) 



= rank |r<") B (q« u) )" [{H^V,}^^]) 
= r ank((Q^) W [{H M Q^}^^ 
= rank((QW) W [{H M QW}^ 



blkdiag 



'{r, w } x 



(15) 



where blkdiag (Ai, . . . , A n ) denotes the block diagonal matrix that has as 2th diagonal block the matrix 



Aj, the above equalities hold due to the fact that rank ( R| U M = rank ( Rj"'' J = d. Furthermore, we have 

rank(S fc ) = rank (q^) H H m Q?)rW) 

= rank^(Q( M) ) i/ H fc , fc Q^ ) ^ = d. 

Hence, orthogonalization is always possible when d < min(M t ,M r ). 

Remark 4: Observe that we can generalize V to the case where user k is equipped with M t: k antennas, 
receiver k with M r ^ antennas, and the k user's signal space spans dk dimensions, k G K. This generalized 
version of V can be used to decide the achievability of any DoF tuple {di,d^, ■ ■ ■ ,dx}'- if this tuple 
is achievable the cost function of V will be zero. However, this is an NP-hard problem for the case of 



March 17, 2011 



DRAFT 



10 



M t> k,M t> k > 2 lfl3l . Therefore, the generalized version of V has to be at least as hard as determining 
the achievability of a DoF tuple. 

To conclude, we have established that the minimization of the sum of the interference dimensions under 
full rank signal space constraints is equivalent to maximizing the sum DoF of a static flat-fading MIMO 
interference channel. There exist various instances and regimes of difficulty for this RCRM problem. 
There are tractable regimes where one randomly selects the precoding or zero-forcing matrices matrices 
and constructs the zero-forcing or precoding matrices with columns that exactly fit in the null space of 
the interference or reciprocal interference matrices. This is possible when either d < M t — {K — l)d, or 
d < M t —(K—l)d holds. Moreover, when the channel matrices are diagonal, the symbol extension method 
presented in [2] creates instances of the RCRM problem that can be efficiently solved asymptotically. 
However, in the general case such solutions are NP-hard to obtain and the RCRM problem cannot be 
efficiently solved. In the next section we provide a heuristic that approximates V. 

IV. A Nuclear Norm Heuristic 

In the previous section we establish that maximizing the sum DoF of a if -user MIMO interference 
channel is equivalent to solving an RCRM, where the precoding and zero-forcing matrices are the opti- 
mization variables. To approach this highly nonconvex and intractable problem we use convex relaxations 
for the cost function and constraints of V. 

We begin by obtaining the tightest convex approximation to the cost function of V. We have 

/ K \ 



conv | rank (Jfc) J = conv (rank (blkdiag (Ji, . . . , Ja"))) 
1 



\k=l 



blkdiag (J l5 ...,J A -)|L (16) 



K K 



-Eii j *il = -EI> ( Jfc )' 



" k=l ^ k=l i=l 



where conv(/) denotes the convex envelope of a function /, ||A||* = X]i=i^ °"i(A) is the nuclear 
norm of a matrix A which accounts for the sum (i.e., the ^i-norm) of the singular values of A, and 



<ji (A) is the ith largest singular value of A. This normalized sum of nuclear norms in ( 16 1 is the convex 
envelope of the sum of interference ranks when the maximum singular value of the interference matrices 
is upper bounded by fi > lTT9l . More formally, this is possible when we operate on the following sets 
of interference matrices {J& G (fcdx(K-i)d^ \/A; £ K; max^gx: o\ (Jfc) < ^}. 

Before we proceed with approximating nonconvex rank constraints by a convex feasible set, we provide 
some insights on the algorithms presented in [9] and [ 14]. These algorithms aim to minimize, in alternating 
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optimization fashion, the total interference leakage at each receiver, a metric defined as 

K 

J>{u£Q fc U fc }, (17) 

fc=i 

where 

- P 

E j h *j v i v / Hh &. 

subject to orthogonality constraints of the columns of the precoding and zero-forcing matrices, i.e., 
Vj^Vfc = K\d and U^Ufc = I4, for all k G /C. At each step of the optimization, either the precoding 
or zero-forcing matrices are fixed, and minimization is performed over the free variables. Observe, that 



if we plug ( [18] ) in < \T7) we get 

k ( Ik 



EH U *( E fHw^VfHfr U fe 

fe=i [ y=i,i^/s y 



fe=i 

P X>{j fc jf} = ^x> fc ! 



(19) 

,/ ' ' J ,/ ^ 

fe=l fe=l 

A' d 
fc=l i=l 

where ||A||^ is the Frobenius norm of A and the constant K can be dropped in the minimization. 
Therefore, the interference leakage metric is the £2 norm of the singular values of all interference matrices, 
i.e. the sum of "interference energy" at all receivers. 

Experimentally, it has been observed that the alternating leakage minimization performs well and 
yields perfect IA solutions for various instances of proper systems. However, when it does not yield 
perfect IA for systems that are proper, it outputs precoding and zero-forcing matrices that result to "low" 
energy interference, i.e., interference singular values with small ^-norm. For such solutions interference 
may be weak, nonetheless its span is not confined to low dimensional subspaces. Potentially, it spans 
more dimensions than the sparsest possible solution. Moreover, there are known configurations for which 
it cannot output solutions that give full rank signal spaces. These are cases of channel matrices with 
specific structure, such as symbol extended channels. There are also some interesting setups, such as 
cellular interference channels, where the leakage minimization approaches have not yet been generalized 
to and sum-DoF maximization is again a well motivated objective to pursue. 

Here, we claim that minimizing the ^i-norm of the interference singular values is intuitively expected to 
output low-rank solutions, as it is provably the case for affine constrained, rank minimization problems 
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flT9l , EDI . Low -rank interference is what we were aiming for in the first place, so to maximize the 
sum-DoF. However, we should note that our problem formulation, although a rank minimization itself, 
does not fit exactly in the affine constrained, rank minimization framework of EOl and exact solution 
guarantees cannot be used for our case in a straightforward manner. 

We continue our approximation by obtaining constraints defining a convex and tractable feasible set. 
We approximate the constraint, rank (Sfc) = d, Vfc G K, with 

A min (S fc ) > e, (20) 

Sfc h Odxd, (21) 

where A m i n (Sfc) is the minimum eigenvalue of e > 0, and Sfc >z Odxd denotes that matrix Sfc is hermi- 
tian positive semidefinite; that is for all k G K we have {Sfc G C dxd ; S k = Sf and z H S k z > 0, Vz G C d }. 
We note that the minimum eigenvalue constraint on positive semidefinite matrices serves as a tractable 
constraint yielding a convex feasible solution set. This relaxation might seem stricter than the rank 
constraints, however, this is not the case (considering the initial cost function of the sum of ranks) when 
we replace the closed set defined by A m ; n (Sfc) > e with the open set defined by A m ; n (Sfc) > 0. Although, 
the former set is always a subset of the latter, as e gets smaller, the two sets will asymptotically overlap. 
We proceed by proving that for any feasible solution of the RCRM problem there exists (at least) one 
solution that gives positive definite useful space matrices and preserves all interference and signal space 
rank properties. 

Lemma 2: Let {V;}^ 1 and {U;}^ be any feasible pair of sets of precoding and zero-forcing matrices 
so that rank(Jfc) = p k and rank (Sfc) = d, for any k G 1C. Then, for any such feasible point of V there 



exists a feasible pair of sets for d20b and (21 ), that is 



{Vfc}f =1 = {VfcVf H£fcUfc}f =1 (22) 
and {Ufc}f =1 = {UfcUf Hfc,fcVfc}f =1 , (23) 
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such that 



rank Jj. I U 



I J 1=1., 
= rank (j k (\J k , {Vi}f =l l 

rank (s fc (u fc ,V fe )) 

= rank(s fc (u fel V fc )) = d, 

Kun (S fc (u fc ,V fc )) > 0, and S fc (u fe , V fc ) >- 0, 

and A min (s k (u fc ,V fc )) > 0, and S fc (u fc , V fc ) >- 0, 



,l^k 
,ljtk 



Pk 



(24) 

(25) 
(26) 
(27) 



for any k G /C. 
Proof: Observe that 



rank (J*) 

= rank (uf [{Hfc.jV,},^ 

= rank (A fc Uf [{H^V,}^ ^ J blkdiag (Ai, . . . , A, 
= Pk, 

for any set of full-rank matrices Ai, . . . , A^ £ M, dxd . Using this argument, d24| is true since 



k-k-i. 



and its hermitian are square, full-rank matrices for all k G K. Moreover, (25 1 is true due 
argument, that is, 

rank (Uf H fc>fc V fc ) 
= rank (uf H fc , fc V fc 
= rank (Uf H fe , fc V fe Vjf H^ fc U fc 



Moreover, it is straightforward that 



rank^U£H fc , fc V fc 
rank (Vf Hf fc U fc Uf H M V fc ) = d. 

Amin (Uf H fcifc V fc Vf H^ fc U fe ) 
= min ||Vf H^U fc xg > 0, 

Amin (Vf H? fcUfcljf H fcjfc V fc ) 



(28) 



VfHf fc U fc 
to the same 



(29) 
(30) 
(31) 
(32) 
(33) 



min ||U fc H fc>fc V fc x|| 2 > 0, 

N 2=1 



(34) 



(35) 
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thus, (|26J) and (|27j> are true. □ 
Having provided relaxations for both the cost function and constraints of V, we are stating the steps 
of our approximation algorithm. First, we decide to arbitrarily select the zero-forcing matrices. Then, we 
solve the following convex optimization problem 



•M{u,} z =i 



K 

mi n V||JfclL 

S.t.: A min (Sfc) > €, 

Sfc y Odxd, yk g ic. 

use its solution as an input to A\j H Vjj^J, and then feed the solutions of this optimization back to 
Av MUj^j. We continue by iterating this process. This procedure is stated below as algorithm A{n), 
where n is the number of iterations. 

A{n): 



initialize {U;}^ 1 
for n iterations 
{V,}^ <- Av ({Uj£i 

orthogonalize {Vi} l=v {Ui} i=l 



Observe that this iterative procedure is bound to converge to a local optimum. In the simulations section 
we provide quantitative results for the performance of our proposed approximation and observe that it 
indeed favors matrices that yield low-rank interference solutions for our problem. 

Remark 5: We would like to note a key difference between our iterative approach and the approaches 
of O and lPT4l . For channels that do not have the block diagonal structure, Q almost surely holds when 
using the alternating leakage minimization approach due to the precoding and zero-forcing orthogonality 
constraints. However, this probabilistic argument does no longer hold, at least for the leakage minimization 
scheme, when considering channels with block diagonal structure. Hence, zero interference leakage may 
be obtained using alternating leakage minimization, but at the same time the signal spaces may be confined 
to less than d dimensions not obeying Q ifToll . Interestingly, our approach is robust with respect to channel 
structures since it explicitly involves a positivity constraint on the minimum eigenvalue of the signal space 
matrix, that is Q will always hold for any set of channel matrices. 
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To conclude this section, we have introduced an alternating nuclear norm minimization scheme to 
approximate the sum DoF maximization in the &;-user MIMO interference channel. Our approximation 
is motivated by our RCRM formulation for the sum DoF maximization, when useful signal spaces span 
all available dimensions. In our approach, we relax the rank cost function to its convex envelope, the 
nuclear norm of interference singular values. Then, we approximate the full rank constraints with positivity 
constraints on the minimum eigenvalue of the signal space matrices restricted to be positive semidefinite, 
and showed that asymptotically this is a tight relaxation with respect to the RCRM objective. 



V. Interference Alignment for Cellular Networks 

In this section we consider the case of the if-cell interference channel as presented in ifTTTl . where 
each cell supports d users. We tailor our algorithm for this problem by adding extra affine constraints 
on the entries of the precoding matrices. Such constraints correspond to the fact that each user u in a 
cell k wishes to transmit only one symbol using a beamforming vector n G C <* , where we assume 
^ G N*. For this system, the received signal at receiver k is given by 

d K d 

yfc = a ( kl^k,uXk.u + X] X! ^k} w i,u%i,u + w fc 



u=l 



H 



(i) 
k,k 



H 



(<*) 



Vfe.l 



Vfc., 



Xk,l 



Xk.d 



(36) 



t K 



H 



vi,i ...0m x1 



v/., 



%l.d 



K 



II/^/.V/.X/, • X H fei ;V;X;+W fc , 



where H[ u ? G C A1 ' X & represents the channel between user u of cell I and receiver k, Hk,i 
C M ' xM 'd, and 



(37) 



TX(1) TlM' 
H k,l ■ ■ ■ H k,l 



Vfc,! ... Oju 1x1 



(38) 



0^ xl ... Vk,d 

where Vjt jU represents the beamforming vector used by user u of cell fc,for I, k G /C. Hence, this 
mathematical formulation is equivalent to a general K-user MIMO interference channel where symbol 
Xk :U of the symbol vector = [x^ i . . . is transmitted only from some subset of ^ transmit 

antennas. 



March 17, 2011 



DRAFT 



16 



Ideally, we would like to solve V with the extra affine constraints corresponding to zeros at the 
appropriate entries of We propose the following approximation: run A(n), where Av ({U/}^=i) 
has added affine constraints 

I V fck,« = Ojc(d-i)xl V« G {1, 2, . . . d}, (39) 

and 

1,...,(«-1)^Ju|«^ + 1,...,m| (40) 

represents the sets of indices (rows) that the precoding matrices have zero entries, for all u 6 {1, 2, . . . , d}. 
Observe that no further approximation is made to V due to affine constraints being tractable. In the 
simulations section we observe that the cellular case approximation scheme yields solutions with low 
rank interference matrices, resulting in high sum-rate. 

VI. Simulations 

A. Interference Channel 

In this experimental evaluation we run simulations for a (4 X 8, d = 1, 3) 3 , a (6 X 6, d = 1, 3) 3 , a 2 time 
slot symbol extended single antenna, 3-user interference channel, with d = 1, and a (4 x 18, d = 1, 2) 10 

system. All MIMO systems considered are proper, i.e. d < M ^\ Ir ■ In our simulations, we allocate power 

p_ 

i^p- to each column of the precoding matrices, where P = [0 : 10 : 80]dB, and set the noise power 
level to a 2 = 1. We present results averaged over 200 channel realizations, where each channel element 
is drawn i.i.d. from a real Gaussian distribution with mean zero and variance 1. We plot the sum-rate 
of each system and the average number of interference free dimensions per user. The sum rate we 
plot is computed as R = Yld=i \ logdet (id + (id + JfcJf^) 1 SfcS|M. The number of interference free 
dimensions (for normalized input and output matrices) is calculated as the number of singular 
values of with value greater than 10~ 6 , minus the number of singular values of that are greater 
than 10~ 6 . We should not that this metric does not account for the rate slope at the low SNR regime. 

1 ) 3-user interference channel: First, we consider a (4 X 8, d = 1, 3) 3 and a (6 X 6, d = 1, 3) 3 system. 
For each simulation, we run 5 iterations of our algorithm, 10 iterations of the minimum interference 
leakage algorithm, and 10 4 iterations of the max-SINR algorithm. We also calculate an orthogonalized 
version of the max-SINR outputs, which is denoted as max-SINR with QR in the figures. To run A(5) 
we set e = 0.1 and use the CVX toolbox Ell . In terms of complexity, at each iteration our proposed 
algorithm solves 2 semidefinite programs, the leakage minimization 2 • K eigenvalue decompositions, and 
the max-SINR performs 2-d-K matrix inversions. For our proposed scheme and the max-SINR with QR 
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algorithm 2K QR factorizations are performed to orthogonalize the output precoding and zero-forcing 
matrices. 

In Fig. 1 and Fig. 2, we consider a (4 x 8, d = 1, 3) 3 system and plot the sum rate and average per user 
DoF^] versus P of the interference leakage minimization algorithm, the max-SINR approach of and 
|[T4l . and our scheme, respectively. Again, for all cases considered, perfect IA is expected to be feasible 
with high probability since the systems are proper ifTOll . In Fig. 1 for the d = 1 case, we observe that at 
low to moderate SNRs, the max-SINR solution outperforms both our proposed algorithm and the leakage 
minimization with respect to the achievable data rate. Interestingly, when we shift to higher SNRs above 
40dB, our proposed algorithm matches the performance of max-SINR (with or without QR) and both 
schemes offer a slight rate benefit compared to the leakage minimization approach. For d = 3, we observe 
the same trend at the low-SNR regime, where in this case both max-SINR and leakage minimization 
schemes achieve higher rates compared to our approach. However, the benefits of our algorithm become 
apparent for SNRs above 40dB where the extra DoF achieved yields higher data rates compared to both 
the max-SINR and leakage minimization approaches. In Fig. 2, observe that for d = 1 both our scheme 
and the leakage minimization achieve exactly d = 1 average per user DoF for all SNRs, while the 
max-SINR algorithm exhibits a more adaptive behavior which yields 1 DoF at the high SNR regime, 
where DoF becomes an important factor of the SINR metric. For d = 3, both the max-SINR and leakage 
minimization algorithms do not achieve more than 1 per user DoF, for 10 4 iterations. In this case, our 
nuclear norm approach seems to favor sparse solutions that yield more than 2 DoF resulting to higher 
data rates. 

In Fig. 3 and 4 we consider a (6 X 6, d = 1, 3) 3 system. In Fig. 3 for d = 1, the performance of max- 
SINR and our proposed algorithm approximately match for SNRs greater than 40dB and both schemes 
offer a constant gap rate advantage compared to the leakage minimization approach. For, d = 3 the 
max-SINR algorithm outperforms, both our proposed algorithm and the leakage minimization approach 
for SNRs up to approximately 25dB. For the SNR regime above 30dB, our algorithm does not provide 
extra DoF for 5 iterations, while the interference leakage provides more and yields substantially higher 
data rates compared to both max-SINR and our approach. In Fig. 4 we observe that leakage minimization 
achieves more interference free dimensions compared to our algorithm and the max-SINR approach which 
results to higher achievable per user DoF. It seems that our algorithm, for values of d = M ^[ Ir , performs 

'By a slight abuse of terminology, here we use DoF to denote the number of interference free signaling dimensions at any 
SNR point. 
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better when M t > M r . Interestingly, when d < f^{' all algorithm seem to get the maximum DoF (at 
least in the high-SNR regime) in our simulations. 

2) 3-user, symbol extended, interference channel: In Fig. 5 we consider a single antenna interference 
channel, which we extend across 2 time slots and plot the sum rate versus P of the interference leakage 
minimization algorithm, the max-SINR approach, and our scheme, respectively, and set d = 1. We run 
the interference leakage and max-SINR approaches for 10 4 iterations and our algorithm for 5. For SNRs 
up to 25dB the max-SINR solution gives slightly higher sum-rate compared to our proposed algorithm 
and the leakage minimization. However, due to the diagonal structure the interference leakage scheme 
might generate beamforming and zero-forcing matrices that result in zero eigenvalues of signal spaces, as 
shown in [16]. These signal space deficiencies are avoided in our approach due to the positivity constraint 
on the minimum eigenvalue of each singnal space. We observe that in the high-SNR regime, our approach 
offers a substantial rate increase compared to max-SINR and leakage minimization approaches. 

3) W-user interference channel: In Fig. 6 we consider a (4 x 18, d = 1, 2) 10 system and plot the sum 
rate versus P of the interference leakage minimization algorithm, the max-SINR approach and our scheme, 
respectively. Due to the size of the problem parameters, in this part, we run the interference leakage and 
max-SINR approaches for 2 • 10 3 . For the d = 1 case, we observe a similar trend to the 3-user system: 
at the low to moderate SNR regime the max-SINR solution outperforms both our proposed algorithm 
and the leakage minimization with respect to the achievable data rate. Then, the rate performance of the 
max-SINR and our approach seem to match and be slightly higher compared to the rate achieved by 
the leakage minimization. For d = 2, we observe that up to the SNR of 40dB the max-SINR achieves 
higher data rate compared to our approach and the leakage minimization. Past the 40dB mark, the leakage 
minimization and max-SINR with QR exhibit a zero slope sum-rate curve. Eventually, it seems that the 
extra DoF obtained by our algorithm here give slightly better performance compared to the max-SINR 
at the high-SNR regime. 



B. Cellular Interference Channel 

In Fig. 7, we consider a 3-cell interference channel, where each cell has 2 users. Each user is equipped 
with 3 antennas, and each receiver has 4 receive antennas. For this system, we compare our algorithm 
with a random beamforming (BF) and interference zeroforcing scheme. In the latter scheme, the users 
randomly select beamforming vectors and the receivers use zeroforcing matrices with columns the d 
eigenvectors associated with the d smallest eigenvalues of the interference correlation matrix, like the 



one defined in (18 1. We run these two scheme for 200 channel realizations and plot the data rate versus 
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P = [0 : 10 : 60]dB. Our proposed algorithm runs for 1, 2 and 10 iterations. For 1 iteration our scheme's 
performance is comparable with the random BF and interference zeroforcing. Interestingly, we observe 
that there is a substantial increase in data rate for 2 iterations (approximately 2 times more sum-rate at 
60dB) and 10 iterations (approximately 3 times more sum-rate at 60dB), where our algorithm outperforms 
random BF and interference zero-forcing for all power configurations. 



VII. Conclusion 

To conclude, in this work we reformulated the interference alignment problem as a rank constrained, 
rank minimization. This framework allowed us to introduce individually tight convex relaxations for the 
cost function and constraints of the RCRM problem. Our heuristic was inspired by the nuclear norm 
relaxation of rank introduced in |[T9ll , however, in this paper we did not establish theoretical guarantees 
under which this relaxation is tight. Such a theoretical investigation would be a very interesting open 
problem for future research. 
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Fig. 1. Sum-rate vs. P, for a 3-user system, M r = 4, M\ = 8, and d = 1,3. 
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Fig. 2. Average number of interference free dimensions per user vs. P, for a 3-user system, M r = 4, Mt = 8, and d = 1,3. 



March 17, 2011 



DRAFT 




10 20 30 40 50 60 70 



P (dB) 

Fig. 3. Sum-rate vs. P, for a 3-user system, M t = 6, Mt = 6, and d = 1,3. 
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Fig. 4. Average number of interference free dimensions per user vs. P, for a 3-user system, M, — 6, M t — 6, and d = 1,3. 
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Fig. 5. Sum-rate vs. P, for a 3-user system, single antenna system using a length 2 symbol extension, where d = 1. 
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Fig. 7. Sum-rate vs. P, for a 3-cell interference channel, with 2 users per cell, 3 transmit antennas per user, and 4 antennas 
per receiver. 
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